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ABSTRACT 

The use of the data files contained in the High 
School and Beyond (HSB) research project is discussed. The comments 
are based on an analysis of the HSB material and are specifically 
directed at the language file, high school bilingual program 
participation, and HSB tests-. In ah evaluation of the language file, 
the .✓question of whether Hispanic language minorities are adequately 
represented is addressed^ Regarding bilingual programpartiicipation , 
the question of which HSB survey questions are most applicable in 
ascertaining such participation is considered. Finally, the adequacy 
of the HSB cognitive teits is assessed. \ (RW) 
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ABSTRACT 



Thjs technical notejs Intended to provide users of the HSSB^ data set 
with a f^w of the lessons that the NCBR has learned In Its work oh 
language minority and bilingual education Issues, specifically with 
regards i& three areas: 

• The HS&B language file; 

• Hfgh school bilingual program participation; and 

• HS&B tests. 

___ - ■ , - _ " - - - _ - _ * - 

Further* It contains additional references which may be consulted in 

cont i nu i nq work wi th this rich resource. 
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HIGH SCHOOL AND BEYOND: ISSUES REGARDING THE LANGUAGE FILE, BILINGUAL 
PARTICIPATION AND TESTS 

Marsha J. Hi rano-Nakani shi 



The High School and Beyond (HS&B) data set provides an invaluable 
set of resources for researche^s^of b i 1 i ngual i sm and bilingual 
education. As So ( 1982) m notes t ; - 

J * - - - 
In addition to 7 the rich ndmber of: variables it contains* the HSsB 

data set is also valuable to bjH ngual education in that it - 

includes information on the largestlanguage minority in the U.S., 

i.e., Hi spanics. Rarely has a^natjonal survey on high school x 

education paid sufficient attention to the issues facing ^the 

Hispanic language minority. .Thus, the HSSB data set may be the 

-fijrst national project that ajms to include adequate Hispanic 

i^^ondents in its sample.' (p. 7) y .\ 

- X y x " * 

The National Center for Bilingual Research (NCBR) has begun some 
preliminary analyses using the HSSB data set. In his technical note,- 
So provides a general description of the various data files contained 
In the HSSB "set and "of the data set Vs utility for bilingual education 
research, which serve as an introduction to f ami 1 iar ize readers with 
RS&B. PreJ iminary analyses of the data set with respect to bilingual 
issues also are available {Chan & So, 1982; Sol Chan, 



From time to time, the NCBR will provide technical notes for users 
of "the HS&B data set. Researchers in bi 1 irigualism and bilingual 
education all are working towards the goal of developing a strong, 
empirical knowledge base. To assist researchers in approaching this 
collective goal more efficiently, the NCBR's technical notes will share 
lessons learned in' using data sets, particularly lessons on technical 

* _ _jT _: 

quirks in data-bases which sometimes keep research mired irTprel iminary 

- r " 

explorations and away from more substantive analysis. : 
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This technical note is written to assist users of the data 
set regardmg three areas: 

• The HS&B language file; 

• High school bilingual education prbcfram participation; and 

• HS&B tests. 

More specifically, it looks at the issues of: (1) whether 
Hispanic language minorities are adequately represented in the HS&B 
data set, (2) which HS&B survey questions are most applicable in 
ascertaining bilingual education program participation, and (3) what we 
know about the HS&B cognitive tests. 

The HS&B Lang uage File 

in the HS&B base-year language file, 11,303 respondents are 
identified as language minority youthr(LMY), because these high school 
sophomores and seniors spoke a non-English language before entering 
school, they usually speak a non-English language now, and/or a 
non-English language is^at least one of thfe languages now spoken in 
their homes. - 

tram the National Center for Education Statistics (NCES) report 
(Si lverman, 1978) bh the educational disadvantage of LMY, aged 14-25* 

. _ _ _ . _ 0 

based on the 1976 Survey of Income and Education (SIE), one would 
expect ^that about 3% of the in-schobl and hi gh-schbbl -equivalent youth 
are 1 anguage' minor i t ies . 1 . In- the HS&B data set, the 1 1 ,303 LMY 
respondents translate to an estimated 1 million language minority 
sophomores and seniors national ly--about 15l of the nation's estimated 
6.8 mi 1 1 iort Sophomores and senior?. 



1 3, 77^,000 LMY non-dropouts of 42, 170,000 youth nbn-dropouts. 



3 

Further j in S I E , about W% of the in-school and 
high-school-eqaivalent LMY were estimated to be of Hispanic origin. 
However, in HS&B only about ZS% of the weighted LMY sample are of 
Hispanic origin, while 55% are of European or Canadian backgrounds. 

The estimates struck the staff of the NCBR as potential ly 
problematic: overest (mat I on of LMY and/or undent i mat ion of Hispanic 
LMY seem possible. In a communication with the NCBR (Peng, 1982), Dr. 
Samuel Peng, Project Officer of the HS&B project at the NCES* addressed 
these concerns. 

First, Peng suggested that the discrepancy between SlE- and 
HS&B-est imates of the number of LMY may be a result of different survey 
questions. Peng suggested that the HS&B estimate of language 
minorities was based on a more inclusive definition than that employed 
in the SlE data. Indeed, varying estimates regarding language 
characteristics seem directly related to the differences in wording of 
survey questions. In other work (Lopez, 1982), the NCBR has investi- 
gated discrepancies in estimates deriving from different surveys. 
Discrepancies seem less a function of sampling considerations than of 
differences in the wording of survey questions, and users of the HS&B 
data set are cautioned to take special care in interpreting meaning 
from designations of non-Engl ish language background. Lopez 1 s work 
(1982) should provide a useful reference for interpretations regarding 
language issues* 



- 2 Dropout5 were defined as all 14 to 25 year-old-youth who were hot 
enrolled in school from February to May 1976 *a4 who had not completed 
k years of high school. Non-dropouts, then, were 14 to 25 year-old 
youth who either had a high school equivalent or were enrol led in 
school at the time of the survey. . There were approximately 3,77^,000 
LMY non-dropouts* of Which an estimated 1 ,65^,000 were of Hispanic 
origin; see Silverman* 1978. 



k - 

' Second, Peng agreed that the HS&B estimate of Hispanic LHY may be 
'o^' in using HS&B base-year language data, he suggested including the 
^1 f - r eported non-Hispanic students with Spanish language backgrounds 
*s stydehts of Hispanic origin with a Spanish language background. 
%P ar eHtly, poor questionnaire design of the base-year survey resulted 

3 Hispanic undercount . By f bl lowi rig Peng 1 s recommendat ion, more 
^t^ Ur ate estimates and analyses should result. In the HSSB first 
f^l low^up survey, the questions regarding race and origin have been 

^Ij^h^sghqo l Bilingual or B i cu 1 turalH^rbdram Part ic ipat ion 

The following question appears in HSSB: Have you ever been in any 
Q f th| e following kinds of courses or programs in high school? 

e . Bilingual or bicultural program 



YES 7,419 

TOTAL 58,270 

% YES 12. 7% 

Estimated weighted % YES 3 3% 



The Intention in asking this question in HSSB was to allow 
^e 5e ^r^^^r 5 to identify students who were enrolled In federal Title 
V | 1 , 5 tate> and Local Educational Agency (LEA) bilingual education 
Pi r ogr a fns during high school. The student responses from the High 
S c hOfc] a nd Beyond survey are far from consistent with data in other 
Surveys. 



3The NCBR calculated raw and weighted estimates for the 11,303 
Respondents inthe 1 anguage_f i le, then extrapol ated those findings for 
tb e z$8>270 file. The extrapolation should underestimate the true 
W e i ghted percentage of students responding affirmatively to the survey 
Question. ~« 
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When examining similar results from various' surveys, one expects 
to find discrepancies. However^ the self-reported responses of 
students in High School and Beyond suggest about a 9* participation 
rate in high school bilingual programs, whereas other estimates of high 
school bilingual program participation range no higher than 3l* 

For example, the Office of Civil Rights (1980) contracted Killalea 
Associates to prepare a Users Guide for its Fall 1978 Elementary and 
Secondary School Civil Ri gtits Survey. In that report, an estimated 
660,000 LES/NES elementary and secondary public school students were 
served in bilingual programs, High Intensity Language Training (HitT) 
programs, Engl i sh-as-a-Second-Language ( ESL) programs, or non-language 
classes taught in a language other than English. In percentage terms, 
about I.SSfc of the nation's almost kl million elementary and secondary 
public school students in 1978 were served in bilingual arid other 
language-related programs. In brie sense, this percentage 
underestimates participation in bilingual programs because 
fluent-English-speaking (FES) students also are allowed — and sometimes 
are required--to participate in bilingual programs. However* even 
doubling the number of students served takes us to a participation rate 
of little over 3$ which is still far short of the 9* estimate derived 
from High School and Beyond data. Moreover, the OCR's proportion of 
participation also overestimates high school participation rates: (1) 
OCR's estimate includes non-bilingual program participation, and (2) a 
clear majority of bilingual programs are offered in K-6. 

The National Clearinghouse for Bilingual Education (1981 ) 
estimated that roughly a half million public elem?htary and secondary 
students would be served in various federally-funded bilingual programs 
in 1 980-1 981 . The National Center for Education Statistics (1980) 
projected a national elementary and secondary public school enrollment 
of about 41 million for 1980. These estimates, thus, suggest a 
bilingual participation rate of 1.2$. Certainly* this estimate does 
not include state and LEA bilingual program participation — which may 
double, triple or even quadruple the overall estimate. However, it 



s 



6 



seems unlikely that state and local programming would increase the 
bilingual participation rate over seven-fold. 

in short, estimates of all school -aged students participating in 
bilingual programs are of the order of a half million to perhaps two 
million out of a national student enrollment of 40 million or so. - 
Assuming equal participation rates in all grades (an assumption which 
should overestimate high school participation), at most, a little over 
300,000 students would i>e expected to be enrolled in high school 
bilingual education programs in the. 10th and 12th grades. The High 
School and Beyond estimate suggests that about 600,000 of the nation's 
estimated 6.8 million sophomores and seniors in 1980 participated in 
bilingual programs in high school . 

: The wording of the question in HS6B probably taps responses 

extending beyond high school participation in federal, state and local 
bilingual education programs. Indeed, some students may have misread 
the question and answered "yes" for bilingual program participation irr 
grades K through 9, although there is no way in the current files to 
check 'this. Additionally, some students enrolled in high school 
language. instruction in German, French, Spanish and other languages may 
havee" responded that they had been in a bilingual program, because the 
question did not specifically exclude foreign language instruction. 

. Results from preliminary analysis of HS6B at the NCBR suggest a 
few other 'possibil i ties. Working solely with the 11,303 language * 
mi nor i ty file: 

(1) 1,613 students responded that they took an Engl, isfi course 
assigned for students from non-English speaking backgrounds 
in grades 10-12, which amounts to 2.8% of the 58,270 
sophomore and senior respondents and 1.95$ of the estimated 

. 6.8 mi 1 1 ion sophomores and seniors in the nation; 

(2) 3^921 students responded that they' had taken reading and 
writing courses in grades 10-12 in a language other than 
English—which typified their language background, aga in, 
6.7% and h.7% as above; ; 
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(3) 1,635 responded that in grades 10-12 they had "other 

subjects, such as math or science, taught, at least in part, 
in the non-Engl ish language of their background, or 2.8? and 
\iS% as above; and ^ 

(it) 3,703 responded that they had taken courses in the history or 
culture of their ancestors' country of origin or on their 
life in the United States, which amounts to and ^5?- 

Item (1) probably is HS&B's best identifier of individual 
1 imited-Engl ish proficient high school students. Item (3) probably is 
HS&B's best identifier of individual LMY participation in something 
like high school bi 1 ingual education programs. Item (2) apparently taps 
LMY who took high school bilingual education and high school "foreign" 
language courses in the non-Engl ish language of their background, and 
item (M taps ethnic history and culture high school courses taken by 
LMY. 

Crosstabulat.ions between responses to item (3) and responses to 
the question of high school bi 1 ingual or - b i cu 1 tural program participa- 
tion are reveal ing. About 111 of the estimated Tmill ion LMY answered 
that they were in high school bilingual or bi cultural programs but had 
not take.n courses, 1 ike math or science, taught, at least in part , i n 
the non-Engl ish language of their background; only 3% of the 1 million 
stated they were in bi'l ingual or bicultural high school programs and 
had taken such course work. Whi le bilingual education programs at the 
high school level, need not . i nc 1 udeV^th or science taught in a 
non-Engfish language, such instruction tends to be one feature of . 
secondary level programs. The response suggests misinterpretation of 
the "bi 1 ingual or bicul tural program" question. 

Tentatively, the NCBR bel ieves that item (3) yields' about the best 
information on LMY participation in high school bi 1 ingual education 
programs, and Peng (1982) agrees. Additional ly, Peng has advised the 
.NCBR that the National Opinion Research Center (NORC) , the RS&B 
contractor, currently is doing a validation study to check and resolve 
inconsistencies in responses to language-delated items. These findings 
should stjed more 1 ight on thq qual i ty. of the HS&B -data. ; . - 
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MSsfc Tests . : 

Little information on the technical adequacy of the HS&B test 
battery is currently available at this time. Schrader and Hilton 
( ) 98O ) provide a preliminary analysis of the test battery with respect 
to validity and reliability; however, this initial field test analysis 
was nqt based on a national probability sample. Heyns and Hilton 
( 1982)< provide a history of test development for H5SB, reliabilities 
for the test battery, some discussion on the validity of the tests, 
item analyses for three of the tests and a discussion on ceiling 
effects. General ly, inadequate information on the HSSB test battery - 
how exists. Heyns and Hilton conclude that M a proper assessment of the 
useful ness of the tests as mesures of cogni t i ve growth must await the 
first follow-up results" (1982, p. 89). Peng (1982) has informed the 
NCBR that study on the technical adequacy of the test battery is 
con t i no i ng - % 

Summary 

This technical note is not wri tten as a comprehensive guide for 
bit ingual researchers_us i ng the HS&B data set. Rather, it is intended 
to provide users with a few of the lessons that the NCBR has learned in 
i ts work with the data set and to provide users With some additional 
references which may be consul ted in continuing work with the rich 
resource at our collective disposal , i.e., the High School and Beyond 
data set. 
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